Cluster formation and anomalous fundamental diagram in an ant trail model 
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A recently proposed stochastic cellular automaton model (J. Phys. A 35, L573 (2002)), motivated 
by the motions of ants in a trail, is investigated in detail in this paper. The flux of ants in this 
model is sensitive to the probability of evaporation of pheromone, and the average speed of the 
ants varies non-monotonically with their density. This remarkable property is analyzed here using 
phenomenological and microscopic approximations thereby elucidating the nature of the spatio- 
temporal organization of the ants. We find that the observations can be understood by the formation 
of loose clusters, i.e. space regions of enhanced, but not maximal, density. 

PACS numbers: 45.70.Vn, 02.50.Ey, 05.40.-a 



INTRODUCTION 



Particle-hopping models have been used widely in the 
recent years to study the spatio-temporal organization in 
systems of interacting particles driven far from equilib- 
rium jj], ||, ||, [|, ||, |(| . Often such models are formulated 
in terms of cellular automata (CA) M. Examples of such 
systems include vehicular traffic || ]£], [To[ [llf where the 
vehicles are represented by particles while their mutual 
influence is captured by the inter-particle interactions. 
Usually, these inter-particle interactions tend to hinder 
their motions so that the average speed decreases mono- 
tonically with the increasing density of the particles. In 
the usual form of the fundamental diagram, i.e. the flux- 
density relation, this non-monotonicity corresponds to 
the existence of an inflection point. In a recent letter 
||l2f we have reported a counter-example, motivated by 
the flux of ants in a trail pl|, where, the average speed of 
the particles varies non-monotonically with their density 
because of the coupling of their dynamics with another 
dynamical variable. In [ fl2| we presented numerical evi- 
dences in support of this unusual feature of the model 
and indicated the physical origin of this behaviour in 
terms of a heuristic mean- field argument. In this pa- 
per we present the corresponding detailed analytical cal- 
culations, together with further numerical results, that 
provide deep insight into the model. 



closely related models in Section HI. Sec. IV presents 
results obtained from a microscopic cluster approxima- 
tion. Although this approach does not reproduce the 
observed sharp crossover it will help us to get a better 
understanding of the microscopic structure of the sta- 
tionary state. A heuristic homogeneous mean-field the- 
ory, which was sketched briefly in ref. jl^] , is presented in 
detail in Section [v|. This theory produces better results 
than the cluster approximation. However, it accounts 
only for the qualitative features of the fundamental di- 
agram obtained by computer simulations. Therefore in 
Section ^ we present a new approach which leads to 
the main new results. In this section we have computed 
some new quantities that provide information as to the 
state of occupation of the site immediately in front of 
an ant. These quantities not only help us in identifying 
three regimes of density, with corresponding characteris- 
tic features, but also provide insights that we exploit in 
developing a new scheme for analytical calculations. The 
results of this new scheme, that we call "loose-cluster 
approximation" (for reasons which will be clear in Sec- 
are in reasonably good quantitative agreement 



VI) 



tion 

with the data obtained from computer simulations. The 
effects of replacing the parallel updatin g by random se- 
quential updating is explored in Section VII , The results 
are summarized and conclusions are drawn in Section 



The paper is organized as follows: The ant-trail model 
L2| is defined in Section || and compared with some 



VIII . In two appendices some details of the calculations 
for the cluster-theoretic approaches are given. 



II. THE ANT-TRAIL MODEL 
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The ants communicate with each other by dropping 
a chemical (generically called pheromone) on the sub- 
strate as they crawl forward JlJ, |l5). Although we can- 
not smell it, the trail pheromone sticks to the substrate 
long enough for the other following sniffing ants to pick 
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FIG. 1: Schematic representation of typical configurations; 
it also illustrates the update procedure. Top: Configuration 
at time t, i.e. before stage I of the update. The non-vanishing 
hopping probabilities of the ants are also shown explicitly. 
Middle: Configuration after one possible realisation of stage 
I. Two ants have moved compared to the top part of the 
figure. Also indicated are the pheromones that may evaporate 
in stage // of the update scheme. Bottom: Configuration 
after one possible realization of stage II. Two pheromones 
have evaporated and one pheromone has been created due to 
the motion of an ant. 



up its smell and follow the trail. Ant trails may serve 
different purposes (trunk trails, migratory routes) and 
may also be used in a different way by different species. 
Therefore one-way trails are observed as well as trails 
with counterflow of ants. 

In |f2| ] we developed a particle-hopping model, formu- 
lated in terms of stochastic C A |?| , which may be inter- 
preted as a model of unidirectional flow in an ant-trail. 
As in ref. |Q, rather than addressing the question of 
the emergence of the ant-trail, we focus attention here 
on the traffic of ants on a trail which has already been 
formed. Furthermore we have assumed unidirectional 
motion. The effects of counterflow, which are important 
for some species, will be investigated in the future. 

Each site of our one-dimensional ant-trail model rep- 
resents a cell that can accomodate at most one ant at a 
time (see Fig. |f|). The lattice sites are labelled by the 
index i (i = 1, 2, .... L); L being the length of the lattice. 
We associate two binary variables Si and Ui with each site 
i where Si takes the value or 1 depending on whether 
the cell is empty or occupied by an ant. Similarly, o~i = 1 
if the cell i contains pheromone; otherwise, <7j = 0. 
Thus, we have two subsets of dynamical variables in this 
model, namely, [S{t)} = (&(<), 5 2 (t), S L {t)) 
and {a{t)} = (a x (4 a 2 (t), o^t), a L (t)). The in- 
stantaneous state (i.e., the configuration) of the system 
at any time is specified completely by the set ({5}, {a}). 

Since a unidirectional motion is assumed, ants do not 
move backward. Their forward-hopping probability is 
higher if it smells pheromone ahead of it. The state of 
the system is updated at each time step in two stages. 



In stage I ants are allowed to move. Here the subset 
{S(t + I)} at the time step t + 1 is obtained using 
the full information ({S(t)},{a(t)}) at time t. Stage 
II corresponds to the evaporation of pheromone. Here 
only the subset {cr(t)} is updated so that at the end of 
stage II the new configuration ({S(t + l)},{<r(t + 1)}) 
at time t + 1 is obtained. In each stage the dynamical 
rules are applied in parallel to all ants and pheromones, 
respectively. 

Stage I: Motion of ants 

An ant in cell i that has an empty cell in front of it, i.e., 
Si(t) = I and Si+i(t) = 0, hops forward with 



probability 



Q 



if o- i+ i(t) = 1, 

if o- i+ i(t) = 0, 



(1) 



where, to be consistent with real ant-trails, we assume 
q<Q. 

Stage II: Evaporation of pheromones 

At each cell i occupied by an ant after stage I a 
pheromone will be created, i.e., 



ai(t+ 1) = 1 if Si(t +!) = !. 



(2) 



On the other hand, any 'free' pheromone at a site i not 
occupied by an ant will evaporate with the probability / 
per unit time, i.e., if Sj(t + I ) = 0, o~i(t) = 1 , then 



<7i(t + l) = 



with probability /, 
f with probability I — /. 



(3) 



Note that the dynamics conserves the number TV of 
ants, but not the number of pheromones. 

The rules can be written in a compact form as the 
coupled equations 

Sj (t + 1) = Sj (t) + minfe-i (t), Sj-i(t), I - S, (i)) 
-mm(i h (t),S 3 (t),l-S 3+1 (t)), (4) 



a jit + 1 ) = max(Sj(t + l),Tom(<Tj(t), £,j(t))), 



(5) 



where £ and r] are stochastic variables defined by £j (t) = 
with the probability / and £j(t) = 1 with 1 — /, and 
r/j (t) = 1 with the probability p — q + (Q — q)o~j+\ (i) and 
r/j(t) — with 1—p. This representation is useful for the 
development of approximation schemes. 



III. COMPARISON WITH OTHER MODELS 

In this section we compare the ant-trail model first 
with the Nagel-Schreckenberg (NS) model jl6) to show 
that in various limits it reduces to the NS model with dif- 
ferent hopping probabilities. This comparison also helps 
in formulating the task of our analytical calculation from 
alternative perspectives. We also compare the ant-trail 
model with some other models all of which share a com- 
mon feature: the dynamics of the "particles" are coupled 
to another dynamical variable. 
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A. The Nagel-Schreckenberg model 

The NS model jl6| is the minimal particle-hopping 
model for vehicular traffic on freeways. In the general 
version of the NS model the particles, each of which rep- 
resents a vehicle, can have a maximum speed of V max . 
However, by the term 'NS model' in this paper we shall 
always mean the NS model with V^nax = 1, so that each 
particle can move forward, by one lattice spacing, with 
probability q^s if the lattice site immediately in front is 
empty. 

The most important quantity of interest in the context 
of flow properties of the traffic models is the fundamental 
diagram, i.e., the flux-versus-density relation, where flux 
is the product of the density and the average speed. For 
a hopping probability q^s at a given density p = N/L 
the exact flux F(p) in the NS model is given by 0, [l7| 



1 



Fns(p) = 2 I 1 - V 1 - 4 Qns P(l 



p) 



(0) 



which reduces to Fns{p) = min(p, 1 — p) in the deter- 
ministic limit qNS = !■ 

Note that the expression (^) remains invariant under 
the interchange of p and 1 — p; this "particle-hole" sym- 
metry of the NS model leads to a fundamental diagram 
that is symmetrical about p — i. In contrast, the fun- 
damental diagrams of our ant-trail model (see Fig. §(b)) 
do not possess this symmetry except in the s pec ial cases 
of / = and / = 1. As explained in ref. 03], in the 
two special cases / = and / = 1 the ant-trail model 
becomes identical to the NS model with q^s = Q and 
qNS — Q: respectively, and, hence, recovers the particle- 
hole symmetry in these two special limits. 

The flux F and the average speed V of vehicles are 
related by the hydrodynamic relation F = pV. The 
density-dependence of the average speed in our ant-trail 
model is shown in Fig. ^(a). Over a range of small val- 
ues of /, it exhibits an anomalous behaviour in the sense 
that, unlike common vehicular traffic, V is not a mono- 
tonically decreasing function of the density p. Instead 
a relatively sharp crossover can be observed where the 
speed increases with the density. In the usual form of 
the fundamental diagram (flux vs. density) this transition 
leads to the existence of an inflection point (Fig. ||(b)). 

Assuming that the flux in ant-trail model is given by 
the equation (||) with a an effective hopping probability 
<7cff(p), which depends on the ant density p, we can ex- 
tract q e s(p) by fitting the observed flux with Fns(p), i-e., 
from 




, 07 

0.6 
' 0.5 
0.4 
0.3 



0.2 0.4 0.6 0.8 

Density 

(c) 



FIG. 2: The average speed (a), flux (b) and effective hop- 
ping probability (c) of the ants, extracted from computer 
simulation data, are plotted against their densities for the 
parameters Q = 0.75, q = 0.25. The discrete data points 
corresponding to / = 0.0005(0), 0.001(o), 0.005(«), 0.01(A), 
0.05(D), 0.10(x), 0.25(+), 0.50(*) have been obtained from 
computer simulations; the dotted lines connecting these data 
points merely serve as the guide to the eye. In (a) and (b), the 
cases / = and / = 1 are also displayed, which correspond 
to the NS model with q c a = Q and q, respectively. 



<7cff 



F(l-F) 
p{± ~ P) ' 



(J) 



The effective hopping probability, q c g, is plotted as a 
function of p for several different values of the param- 
eter / in Fig. ||(c). In the limit p —> 0, the pheromone 
dropped by an ant gets enough time to completely evapo- 
rate before the following ant comes close enough to smell 



it; therefore the ants' hopping probability is almost al- 
ways q. On the other hand, in the opposite limit p — * 1, 
the ants are too close to miss the smell of the pheromone 
dropped by the leading ant unless the pheromone evapo- 
ration probability is very high; consequently, in the limit 
the ants hop most often with the probability Q. 
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A proper theory of the ant-trail model should repro- 
duce the non-monotonic variation of the average speed 
with density (shown in Fig. ||(a)) and, hence, the unusual 
shape of the fundamental diagram (shown in Fig. ||(b)). 
In this paper we develope theories which, indeed, repro- 
duce these features. 



B. Models with coupled dynamical variables 

Models with coupled dynamical variables have been 
considered earlier, for example, in the context of reaction- 
controlled diffusion |fl8| . However, in this subsection we 
compare the ant-trail model with some more closely re- 
lated models where the movement of the "particles" is 
totally asymmetric. 

In the ant-trail model developed in ref. the par- 
ticles, which represent the ants, move in a "ground- 
potential landscape" created by the pheromones. A sim- 
ilar approach has also been used for studying the human- 
trails of pedestrians . 

In the CA model introduced in ref. for pedestrian 
dynamics, the floor-fields, albeit virtual, are analogs of 
the pheromone fields {a} in the ant-trail model. How- 
ever, these floor-fields are "bosonic" in the sense that 
the variable a, which is by definition non-negative, has an 
otherwise unrestricted range. In contrast, in our ant-trail 
model the pheromone field is "fermionic" as the variable 
<7, representing pheromones, can take only two values, 
namely, (absence) and 1 (presence). 

The ant-trail model we propose here is closely related 
to the bus route model (2lj] with parallel updating [ p2[ . 
In fact, as we'll argue now, the ant-trail model and the 
bus route model are the two opposite limits of the same 
generalized version of the NS model of vehicular traffic. 
The ants are the analogs of the buses while the cells ac- 
comodating ants in the ant-trail model arc analogs of the 
bus stops in the bus-route model. Both the models in- 
volve two dynamical variables; the variables S and a in 
the ant-trail model are the analogs of the variables repre- 
senting the presence (or absence) of bus and passengers, 
respectively, in the bus route model. Just as the number 
of buses is conserved in the bus-route model, the number 
of ants is also conserved in our ant-trail model. Simi- 
larly, the dynamical variable representing the presence 
(or absence) of pheromone is not conserved in the ant- 
trail model just as the number of passangers is not con- 
served by the dynamics of the bus-route model. However, 
there is a crucial difference between these two models; in 
the bus-route model Q < q (as the buses must slow down 
to pick up the waiting passengers) whereas in our ant- 
trail model Q > q (because an ant is more likely to move 
forward if it smells pheromone ahead of it). In addition, 
the pheromone are dropped by ants (whereas passengers 
arrive at the bus stops independent of the buses) while 
passengers are picked up by buses (whereas pheromones 
evaporate independently) . 



IV. 



CLUSTER APPROXIMATION 



The simulation results indicate that correlations be- 
tween different ants as well as between ants and 
pheromone play an important role. We therefore develop 
a microscopic "(2+1) "-cluster approximation || [l7j ||^] 
which allows the inclusion of correlations between the 
occupation variables Sj-%(t) and Sj(t) of two successive 
sites j — 1 and j (corresponds to "2" ) and that between 
the variables Sj(t) and <Tj(t) at the same site j (corre- 
sponds to "1") in an exact way. 

The central quantities of the (2+l)-cluster approxima- 
tion are the eight variables 



p 



s 3 (t) 



(8) 



corresponding to all possibilities (Sj~i(t), Sj(t),aj(t) S 
{0, 1}) of finding the corresponding configurations of S 
and a at a time. In Appendix ^ we will show how the 
master equation for these quantities can be derived from 
microscopic considerations and how the resulting equa- 
tions can be solved consistently. 
The flux is given by 



F = q cS P(10). 



(9) 



In Appendix |A] it is shown that within the (2+l)-cluster 
approximation considered here, F can be obtained from 
the solution of the cubic equation 

The result is shown in Fig. 0. For all values of / in the 
range < / < 1, the peak of the flux appears at p > 1/2, 
in qualitative agreement with the general trend observed 
in Fig. |^. But, this (2+l)-cluster approximation cannot 
reproduce the sharp rise in the fluxes observed in Fig. ||. 
Note that in each of the three cases Q = q, f = and 
/ = 1 the solution of jTo| ) is identical to ([j|) with either 
qNS = q or q NS = Q. 

Next let us define P(m) as the probability of finding 
m-size cluster of ants in a stationary state. Here the 1- 
size cluster is defined by • ■ • 010 • • ■ , and a m-size cluster 
consists of a string of m of "1" between "0"s. The distri- 
bution of cluster sizes is then given by (see Appendix [A|) 



P(m) 



P(10) 



pL' 



(11) 



In Fig. [| we illustrate the graphs of P(m) given by 
eq. ([ll]) and corresponding numerical data. There is a 
sharp peak at to = 1 at all the densities and the distri- 
butions are exponential. This means that large clusters 
of ants are rarely seen in this model. Moreover, (JTTI) 
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FIG. 3: Fundamental diagrams in the (2 + l)-cluster approx- 
imation. The hopping probabilities are Q — 0.75, q = 0.25. 
The same symbols in Fig. |i| and in this figure correspond to 
the same values of /. 
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FIG. 4: Cluster-size distribution for p = 0.1, 0.3, 0.5, 0.8. The- 
oretical curve (solid line) given by (^lj) underestimates the 
simulation (broken curve) at densities p < 0.5. Other rele- 
vant parameters are Q = 0.75, q = 0.25, / = 0.005. 



fits well with the numerical data for all p > 0.5, but it 
underestimates the simulations data at lower densities. 

In order to get a better understanding of the micro- 
scopic structure of the stationary state, we also calculate 
the probabilities of finding an ant (P a ), pheromone (P p ) 
and nothing (Pq) in front of an ant: 



Pa = 1- 



P(10) 



P 



Pn 



p(i-p) V 1 
p pi 1 - p) 



(12) 
(13) 
(14) 



Note that the sum of these three probabilities is 1. The 
results are shown in Fig. [| We see that only for small 
and large values of / (e.g., / = 0.0001 and / > 0.1) the 
results of the (2 + l)-cluster approximation are in good 
quantitative agreement with the corresponding numerical 
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FIG. 5: Probability of finding an ant (solid curve), pheromone 
(fine broken curve) and nothing (coarse broken curve) in front 
of an ant, with parameters / = 0.0001, ■ • • , 0.5, in the (2 + 1)- 
cluster approximation. Numerical data, obtained from com- 
puter simulations, are also plotted (ants(»), pheromone but 
no ant(o) and nothing(x)). These figures show demonstrate 
how the predictions of the (2 + l)-cluster approximation de- 
viate from simulation data. 



results. 

The results derived in this section indicate that the mi- 
croscopic cluster approximation is not able to capture the 
correlations which lead to the sharp crossover observed 
for small evaporation probabilities /. A systematic ex- 
tension of this approximation scheme is, in principle, pos- 
sible and more correlations could be taken into account. 
However, this approach will become quite cumbersome. 
In Appendix [B| we have also tried to extend the results 
in this section by using the stochastic cluster approach 
p4j , but the results are not much improved. In the fol- 
lowing we, therefore, develope a phenomenological mean- 
field theory which tries to capture the essential effects in 
a simple way. 



V. HOMOGENEOUS MEAN-FIELD THEORY 
(HMFT) 

In this mean- field theory (MFT), let us assume that 
all the ants move with the mean speed V which depends 
on the density p of the ants as well as on /; although, 



6 



to begin with, the nature of these dependences are not 
known we'll obtain these self-consistently. 

Let us consider a pair of ants having a gap of n sites in 
between. We designate the leading ant of this pair as the 
lead ant (LA) and the other as the following ant (FA). 
The probability that the site immediately in front of the 
FA contains pheromone is (1 — f) n ' v . Here n/V is just 
the average time passed since the LA has dropped the 
pheromone. Therefore, in this zeroeth level MFT, the 
effective hopping probability is given by 



Q(l-f) n/V + q{l-(l-f) n/V } 



(15) 



In the mean-field approximation, we replace n by the 
corresponding exact global mean separation (ri) = - — 1 
between successive ants, i.e. we are assuming the exis- 
tence of a homogeneous state. Moreover, since V max = 1 
the average speed V is identical to the effective hopping 
probability, and we get the equation 



vo-q 

Q-q 



= (1-/)' 



(16) 



which is to be solved self-consistcntly for getting rjo as a 
function of p for a given /. 

Before solving the equation ( |l6| ) numerically, note that 
this equation implies that, for given f , lim p ^o ?7o = q\ 
this reflects the fact that, in the low-density regime, the 
pheromone dropped by an ant gets enough time to com- 
pletely evaporate before the FA comes close enough to 
smell it. Equation ( |l6| ) also implies that lim p ^i 770 = 
Q] this captures the sufficiently high density situations 
where the ants are too close to miss the smell of the 
pheromone dropped by the LA unless the pheromone 
evaporation probability / is very high. Similarly, from 
the equation ( |l6|) we get, for given p, lim/_»i r/o — q and 
limy^o^o = Q-, which are also consistent with intuitive 
expectations. 



The solutions of (16), calculated numerically by using 
Newton method, are plotted in Fig. |](b) and the cor- 
responding fundamental diagram is shown in Fig. ^|(a). 
Clearly, the HMFT captures the qualitative features of 
the ant-trail model. However, there are significant quan- 
titative differences between the predictions of this theory 
and the computer simulation data, especially, the sharp 
crossover around p — 0.5 (Fig. ||). One possible reason 
is that the HMFT assumes a rather homogeneous sta- 
tionary state. Therefore, in the following section we will 
develope an approximation scheme which emphasizes the 
formation of a special kind of cluster in the steady state. 



VI. "LOOSE'' 



CLUSTER APPROXIMATION 

(LCA) 



Let us consider again the probabilities P a , P p , Pq de- 
fined in the previous section. For the purpose of clarify- 
ing some subtle concepts of " clustering" we replot these 




FIG. 6: The fundamental diagram, obtained in the HMFT, is 
plotted against density in (a) while the corresponding effec- 
tive hopping probability 770 is shown in (b). The predictions 
of the HMFT are shown by the continuous curves; the same 
symbols in Figs. I and I correspond to the same values of /. 
The broken curve in (a), corresponding to the computer simu- 
lation data for / = 0.005 taken from Fig. ^|(a), highlights the 
limitations of the HMFT in making quantitatively accurate 
predictions. 



probabilities for only two specific values of / in Fig. [7]; 
these data have been obtained from computer simulations 
of our ant-trail model. 

There is a flat part of the curves in Fig. [?] in the low 
density regime; from now onwards, we shall refer to this 
region as "region 1". Note that in this region, in spite 
of low density of the ants, the probability of finding an 
ant in front of another is quite high. This implies the 
fact that ants tend to form a cluster. On the other hand, 
cluster-size distribution (Fig. |J), obtained from our com- 
puter simulations, shows that the probability of finding 
isolated ants are always higher than that of finding a 
cluster of ants occupying nearest-neighbor sites. 

These two apparently contradictory observations can 
be reconciled by assuming that the ants form "loose" 
clusters in the region 1. The term "loose" means that 
there are small gaps in between successive ants in the 
cluster, and the cluster looks like an usual compact clus- 
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FIG. 8: Schematic explanation of the loose cluster. H is the 
hopping probability of ants inside the loose cluster and h is 
that of the leading ant. 
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FIG. 9: The stationary loose cluster. The average gap be- 
tween ants becomes h/H , which is irrelevant to the density of 
ants. 



FIG. 7: Numerical results for the probabilities of finding an 
ant(«), pheromone but no ant(o) and nothing(x) in front of 
an ant are plotted against density of the ants. The parameters 
are / = 0.005 (in (a)) and / = 0.01 (in (b)). See also Fig. |. 



ter if it is seen from a distance (Fig. ||). In other words, 
a loose cluster is just a loose assembly of isolated ants. 
Thus it corresponds to a space region with density larger 
than the average density p, but smaller than the maximal 
density (p = 1) of a compact cluster. 

Let us assume that the loose cluster becomes station- 
ary after sufficient time has passed. Then the hopping 
probability of all the ants, except the leading one, is 
assumed to be H, while that of the leading one is h 
(see Fig. |8|); the values of H and h are determined self- 
consistently, just as the effective hopping probability in 
the HMFT was estimated self-consistently in Sec. |v|. Be- 
fore beginning the detailed analysis, let us consider the 
properties of H and h. If / is small enough, then H will 
be close to Q because the gap between ants is quite small. 
On the other hand, if the density of ants is low enough, 
then h will be very close to q because the pheromone 
dropped by the leading ant would evaporate when the 
following ant arrives there. 

Next we determine the typical size of the gap between 
successive ants in the cluster. We will estimate this by 
considering a simple time evolution beginning with an 
usual compact cluster (with local density p = 1) without 



any gap in between the ants. Then the leading ant will 
move forward by one site over the time interval 1/h. This 
hopping occurs repeatedly and in the interval of the suc- 
cessive hopping, the number of the following ants which 
will move one step is H/h. Thus, in the stationary state, 
strings (compact clusters) of length H/h, separated from 
each other by one vacant site, will produced repeatedly 
by the ants (see Fig. ^j). Then the average gap between 
ants is 



(f -i)-o + i-i _ h 

H/h H' 



(17) 



which is independent of the density p of ants. Interest- 
ingly, the density-independent average gap in the LCA 
is consistent with the flat part (i.e., region 1) observed 
in computer simulations (Fig. uh. In other words, the 
region 1 is dominated by loose clusters. 

Beyond region 1, the effect of pheromone of the last 
ant becomes dominant. Then the hopping probability of 
leading ants becomes large and the gap becomes wider, 
which will increase the flow. We call this region as region 
2, in which the "looser" cluster is formed in the stationary 
state. It can be characterized by a negative gradient of 
the density dependence of the probability to find an ant 
in front of a cell occupied by an ant (see Fig. |?]). 

Considering these facts, we finally obtain the following 
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equations for h and H: 

h — q 



Q-q 



= (1-/) 



L-l 



H-q 
Q-q 



H 



= (1-/)«,(18) 



where I is the length of the cluster given by 



h 



l = pL + (pL-l)-, 



(19) 



and p and L are density and the system size, respectively. 
These equations can be applied to the region 1 and 2, and 
solved simultaneously by the Newton method. 

Total flux in this system is then calculated as follows. 
The effective density p e g in the loose cluster is given by 



1 



Pctf 



1 + h/H' 



(20) 



Therefore, considering the fact that there are no ants in 
the part of the length L — I, total flux F is 



F= l -f(H,p cS ) 1 



where f(H,p eS ) is given by 



f(H,p eS ) 



Tffpcff (1 - p cS 



(21) 



(22) 



Above the density 1/2, ants are assumed to be uni- 
formly distributed, in which a kind of MFA works well. 
We call this region as region 3. Thus we have three typi- 
cal regions in this model. In region 3, the relation H = h 
holds because all the gaps have the same length, i.e. the 
state is homogeneous. Thus h is determined by 



q 



(!-/)< 



(23) 



which is the same as our previous paper, and flux is given 
by f(h, p). It is noted that if we put p — 1/2 and H = h, 
then ( |l8| ) coincides with (|23|). 

We can focus on the region 1 by assuming h = q in 
(||). Under this assumption, we can easily see that the 
flux-density relation becomes linear. In Fig. |l(](a), the 
two theoretical lines are almost the same, and the gra- 
dient of numerical results are also similar among these 
values of /, which is quite similar to the theoretical one. 
In Fig. [To|(b) , the results obtained from ( p"8| ) in the region 
p < l/2are shown. Above this value of density, equa- 
tion is used. The jointed curve fits quite well the 
numerical one. 



VII. ANT-TRAIL MODEL WITH 
RANDOM-SEQUENTIAL UPDATING 

In our earlier published work [l2] | as well as in this pa- 
per so far we have considered only parallel updating of 
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FIG. 10: (a) Fundamental diagrams of the linear region (bold 
line) together with numerical results with parameters / = 
0.005 (broken curve) and / = 0.01 (solid curve), (b) The 
fundamental diagram (/ = 0.005) of the combination of LCA 
and (^) (solid curve). The broken curve is the numerical 
result for / = 0.005. The system size is L = 350. 



the states of the model system. However, in some mod- 
els different updating schemes are known to give rise to 
nontrivial differences. For example, the correlations ob- 
served in the NaSch model (l(| with parallel dynamics 
and Umax = 1 totally disappear when the parallel updat- 
ing scheme is replaced by random sequential updating. 
In contrast, the updating scheme does not make much of 
difference in the bus route model ^|. Therefore, in 
this section we examine the effects of replacing the paral- 
lel updating by random sequential updating, particularly 
on the unusual features of the fundamental diagram. 

In the ant-trail model with random sequential updat- 
ing, the updating of the system is done the following way: 

1) A site is choosen randomly. 

2a) If there is no ant, but a pheromone, at the chosen 
site this is allowed to evaporate with probability /. 

2b) On the other hand, if there is an ant at the cho- 
sen site, the usual motion update is done (i.e., it 
cannot move forward if the site in front is occupied 
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FIG. 11: The flux of the ants, in the ant-trail model with 
random sequential updating, plotted against their densities for 
the parameters Q — 0.75, q = 0.25. 



by another ant; otherwise, it moves forward with 
probability Q or q depending on whether the site 
in front contains or does not contain pheromone). 

3) If the ant at the randomly chosen site moves for- 
ward, a pheromone is created at the new site with- 
out making any attempt to let the pheromone left 
behind in its old position (i.e., at the randomly cho- 
sen site) to evaporate. 

The flux of the ants in this model is plotted against 
their density in Fig. [n]; the qualitative features of the 
curves, including the sharp crossover from free to con- 
gested state, are similar to those in the original version 
of this model with parallel updating. From these obser- 
vations we conclude that, unlike the NaSch model, the 
correlations responsible for the non-monotonic variation 
of the average speed with the density of the ants are not 
artefacts of the parallel update scheme but genuine non- 
trivial features of the model. 



VIII. CONCLUDING DISCUSSIONS 

A stochastic cellular automaton model of an ant trail, 
which we have proposed recently Jl2| , has been inves- 
tigated in detail, both analytically as well as numer- 
ically, in this paper. The model is characterized by 
two coupled dynamical variables, representing the ants 
and the pheromone. The coupling leads to surprising 
results, especially an anomalous fundamental diagram. 
This anomalous shape of the fundamental diagram is a 
consequence of the non-monotonic variation of the aver- 
age speed of the ants with their density in an intermedi- 
ate range of the rate of pheromone evaporation. These 
unusual features of the ant-trail model have been ana- 
lyzed in this paper using various analytical approaches 
and computer simulations. 

It is shown that the homogeneous mean-field approxi- 
mations are able to capture some of the qualitative fea- 



tures observed in the computer simulations. However, 
these approximations cannot account for the quantitative 
data. Therefore, we have analyzed the spatio-temporal 
organization of the ants and pheromone in the station- 
ary state. This provided some insights which we have 
utilized to develope a new scheme of calculations that we 
call "loose-cluster approximation" . 

By studying appropriate correlation functions we were 
able to distinguish three different regimes of density. At 
low densities (region 1) the behaviour is dominated by the 
existence of loose clusters which are formed through the 
interplay between the dynamics of ants and pheromone. 
In region 2, occuring at intermediate densities, the en- 
hancement of the hopping probability due to pheromone 
is dominant. Finally, in region 3, at large densities the 
mutual hindrance against the movements of the ants 
dominates the flow behaviour leading to a homogeneous 
state similar to that of the NS model. 

We have seen that the observed effects persist for ran- 
dom sequential updating. For this case we also expect 
that exact results can be achieved by using the matrix- 
product technique ^5|. Extensions of this model, 
including counterflow and random sequential dynamics, 
will be reported in the future. 
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APPENDIX A: (2+l)-CLUSTER 
APPROXIMATION 

In this appendix we provide details for the "(2+1 
cluster approximation scheme developed in Sec 
There we have introduced the eight dynamical variables 
(||) which allow to take into account correlations between 
occupation numbers of consecutive sites and between oc- 
cupation numbers of ants and pheromone. 

These variables are not independent. Instead we can 
immediately write down the following six equations 



IV 



P 



P(00) + P(01) 


1 



p 



p 



p 



P(10) 

1 



P(10) + P(ll) 

S) + 'G 

P(00) + P(10) 



P(01),(A1) 


0. 


(A2) 


1, 


(A3) 


1, 


(A4) 


1 - 


p, (A5) 


1 - 


p, (A6) 



where p is the ant density. Equation (JAlj) expresses the 
particle-hole symmetry condition while the equation (|A2|) 
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is a consequence of the definition of the model. The other 
equations are known as Kolmogorov consistency condi- 
tions §|. 

We need more two equations in order to obtain the 
expression for all the eight variables in (ph. These are 



obtained by considering the master equations for, say, 
P(00) and P ( ^ ^ . The master equation for P(00) is 
given by 



P(00) 



P(00) 



P(00) + P(10) 
P(10) 



P(00) + P(10) 



P(00) 



(1 



P(1Q) 



P(00) H- 

«off)P(01) 



P(10) 

PjM 

P(10) + P(ll 



(1 - g off )P(00) 



P(00) 



P(00) + P(10) 



P(01) 



P(10) 



P(10) + P(ll) 



"<?cff, 



(A7) 



where P(00) is P(00) of the next time step, i.e., at the 
time step t + 1 while the probabilities on the right hand 
s ide refer to the time step t. The four terms in the r.h.s of 
(A7) comprise all the configurations and processes that 
give rise to the configuration (Sj-iSj) = ( 00) in the next 
time step. Here we put P(00) = P(00) in ( A7) in order to 
obtain the stationary solution for P(00). Then we have 



P(00) 



(1 - <7cff)P(10) 2 



(A8) 



p-P(10) 

Thus substituting (A8) into ( |A5| ) using (^), we obtain 
F 2 - F + qeS p(l - p) = 0. (A9) 





Similarly, the master equation for P 



is given by 



P 







P(00) 



p 



P(00) + P(10) 
P(00) + P(10) 







p 







-p 



g C ffP(iO) 



(1 - /) 



(l-«feff)(l-/) 



:(!-/)■ (Aio) 



Using P 



1 



1 J P(10) + P(11) 
p, we obtain the stationary solution 



from ( AlOp as 



P 







(1-/)^ 
1 - f ' 

1 ~ P 



(All) 



where we use the relation 



qP 



F = <ZeffP(10)=P(10)- 



QP 



P 



(A12) 



From ( |A12| ) and ( |All| ) we have 

(1 - f)F 



(Q-q) 



(l-p)/ + (l-/)p- 



(A13) 



Finally, substituting ( A13) into ( |A9| ) we obtain the cubic 
equation (^oh for the flux F. 

We can also calculate the distribution of cluster sizes 



defined in Sec. IV. We can write it as 

m—l 



P(10) 



P{m) - c P ^ 01 > \P(10) + P(ll) J P(10) + P(ll) 



1 P(10) s 
C p 



1 p(w)Y 
p J 



(A14) 



Here C is determined through the normalization condi- 
tion J2m=i P( m ) — 1j where L is the system size, as 



C = P(10W1- 1 



Thus P(m) is given by 
Let us also consider t 



P(10)\ 
P ) 



(A15) 



le the probability of finding an 
ant, phcromone and nothing in the front site discussed in 
Section [v|. The probability of finding an ant is simply 
given by P(ll). The probability of finding pheromone 
without an ant, and that of nothing are given respectively 
by 



P 



P(10)- 



P 



P 



P 







, P(10)- 



p 











p 





1 

Normalizing these quantities by dividing p, we obtain 





each probability by only using P(10) and P 
given in equations (p^)-(p^). 



as 



APPENDIX B: STOCHASTIC CLUSTER 
APPROXIMATION 

Let us extend the analysis in the Appendix |A] following 
the approach used in analyzing the stochastic car clus- 
ter model proposed in p4|. In the model, one cluster 
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of cars is assumed to exist in the background of station- 
ary uniform flow, while in Appendix |A| we only consider 
the uniform flow to derive flux of ants, and neglect the 
clustering effect. The cluster-size distribution P(m) was 
derived as the stationary solution of its master equation 
in [pit . However, since we have already obtained P(m), 
we will use ( p"l| ) instead of considering the master equa- 
tion. The flux in cluster is considered to be zero, thus 
total flux in a given configuration of this system is given 
by x (m — l)/L + F m x (1 - (m — l)/L) if m-size clus- 
ter exists. Here F m represents the uniform flux under 
the existance of m-size cluster, which is defined by using 
© as 



F^-F m +p m (l—p m ) < q 



(Q-q)(l-f)F m 
(l-p m )f + (l-f)F„ 



and p m is given by 



Pm = 



p-(m-l)/L 
1 - (m - l)/L' 



= 0, 
(Bl) 



(B2) 



In these equations we take into account that the density 
of the uniform flow is reduced due to the existance of 
m-size cluster. 

Thus the flux of this stochastic cluster approximation 
is finally given by 



F{p) = Y,P{m)U- 



m — 1 
L 



1 rr 



(B3) 



Note that if only the first term on the r.h.s of ( p3| ) is 
retained and all the other terms are dropped the expres- 
sion for F(p) reduces to the the fundamental diagrams 
obtained in the (2 + l)-cluster approximation (and plot- 
ted in Fig. ||). We have evaluated flB3| ) numerically by 
using the distribution ([Tl|), but the results are almost 
the same as Fig. || and, therefore, not shown here. This, 
however, is not surprising in view of the fact that the 
r.h.s of (B3) is dominated by m = 1 because of the sharp 
peak of P(m) at m = 1. 
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